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Field of the Invention 

This invention relates to network topologies applicable to different types of 
networks, such as packet-based data communication networks. 

Background of the Invention 

Many technological systems are based on large networks. These include 
telephone networks, multi-processor computer arrays, and packet-based computer 
networks, such as Local Area Networks (LANs) or the Internet. The performance of 
network technologies therefore has an impact on a variety of disciplines, and, as a result, 
numerous types of network topologies have been proposed. 

Two well-known network topologies include lattice and star topologies. As 
shown in Fig. 1, star (or "mesh") topologies simply provide a single connection between 
every node. As a result, the total hop distance is always equal to one under non-fault 
conditions. And even under single fault conditions, star topologies will exhibit uniform 
and predictable performance, with a maximum hop distance of two. 

Unfortunately, star topologies require a large number of interconnections, which 
can make them difficult to implement in practical systems. The number of links required 
for a network that has n nodes is equal to: 



I(n-l) orn(n-l)/2 



This formula shows that a 25-node network, for example, would require 300 links to 
interconnect all of its nodes using a mesh topology. Some of the characteristics of other 
network sizes are outlined in Table 1 . 
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Table 1 



The characteristics listed in table 1 show that the star topology performs 
uniformly under both normal and fault conditions. Because there are connections 
between all nodes, traffic between any two nodes does not affect traffic between other 
node pairs. As the number of nodes increases, however, the connectivity level becomes 
much more impractical to implement within either a high-density fabric or an external 
backbone. 

Lattice topologies form a cube in three-dimensional space, as presented in Fig. 2. 
Each node in this type of topology has six connections, with one to each of its neighbors. 
Larger numbers of nodes result in a larger cube, with more interconnections and more 
hops between more distant neighbors. Table 2 depicts several characteristics for cubic 
lattice topologies of varying densities. 

Node Node Links Total Congestion Min. Max. 
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(n) Corner: 8 @ 3, Edges: 12(n-2) @ Links Ratio Hops Hops 
n A 3 4, Face: 6 (n-2) A 2 @ (n A 3)(n-l) 

5, Inner: (n-2) A 3 @ 6 



27 (3) 


8@3, 12@4, 6@5, 1@6 


54 


4/1 


1 9 


64(4) 


8@3, 24@4, 24@5, 8@6 


192 


4/1 


1 12 


125(5) 


8@3, 36@4, 54@5, 27@6 


500 


4/1 


1 15 


216(6) 


8@3, 48@4, 96@5, 64@6 
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4/1 


1 18 


343(7) 


8@3, 60@4, 150@5, 125@6 


2058 


4/1 


1 21 


512(8) 


8@3, 72@4, 216@5, 216@6 


3584 


4/1 


1 24 


729(9) 


8@3, 84@4, 294@5, 343@6 


5832 


4/1 


1 27 



Table 2 



The first column of Table 2 presents the total number of internal interconnected 
nodes, the second column lists the number of nodes and their respective connectivity 
density, and the third column presents the total number of internal connections required 
within the lattice. The contents of this third column show an improvement in 
connectivity density over the star topology. Unfortunately, this improvement comes at a 
price, however, and this price is apparent from the fourth column, which lists the number 
of external nodes feeding an internal link before the internal link congests. This number 
represents the ratio between the external carrying capacity and the internal carrying 
capacity, and is four for this network topology. But because each interior and face node 
has more than four neighbor node links, interior and face node links may congest from 
immediate neighbor node traffic. The congestion performance for this topology is 
therefore highly inter-dependent and non-deterministic for traffic between any arbitrary 
set of source and destination pairs. 

Numerous variations and modifications of these two basic network topology types 
have been proposed. Yet despite significant demand for improvements in network 
performance, none of these has been conclusively shown to present an optimal solution 
for high-speed, efficient, and cost-effective handling of traffic in large networks. 
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Summary of the Invention 

Several aspects of the invention are presented in this application. These are 
applicable to a number of network technologies. 

Networks organized according to principles of the invention can exhibit better 
performance than networks that are based on both star topologies and lattice topologies. 
Networks according to the invention can exhibit better congestion performance than 
lattice topologies because the arrangement of node capacities can be defined such that the 
nodes are difficult or impossible to congest. And they can exhibit lower connection 
densities than star-connected topologies because they require fewer interconnections. 

Networks according to the invention can exhibit excellent congestion 
performance as well. Such networks can be designed to allow any node to communicate 
with any other node in the network, as long as each of them has the communication 
capacity necessary. No amount of traffic between other nodes can then interfere with the 
communication. This deterministic performance avoids the performance degradation that 
is often associated with network traffic increases in prior art networks. 

Networks according to the invention can exhibit good hop performance as well. 
Cross-connections in these networks can allow for one or two-hop inter-areas transfers in 
many instances, with longer hop distances resulting only from the number of scale levels. 
And using appropriate routing, the maximum hop distance can be bounded for any given 
fault condition. 

Networks according to the invention may also benefit from much simpler routing 
protocols than do existing networks. Since other network traffic does not affect 
communication between any two nodes, routing protocols need not take this traffic into 
account. As a result, routing logic can be made to be more simple and straightforward, 
resulting in simpler, more reliable, and/or more highly integrated implementations. 

Networks according to the invention may further be advantageous in that they can 
be easily expanded and scaled. Existing networks can be easily upgraded to improve 
performance by scaling groups of their nodes, without requiring changes in topology. 
And additional scale levels can also be added, or partially filled scale levels can be filled 
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in to expand the number of nodes in the network without changing existing portions of 
the network. 

Networks according to the invention may also exhibit improved latency 
performance. 

Brief Description of the Drawings 

Fig. 1 is a three-dimensional network topology diagram of a prior art five-node 
star network; 

Fig. 2 is a three-dimensional network topology diagram of a prior art 64-node 
lattice network; 

Fig. 3 is a three-dimensional network topology diagram for a 25 -node scaled-star 
network according to the invention; 

Fig. 4 is a three-dimensional network topology diagram for a five-node star 
network portion with the addition of a higher scale node, 

Fig. 5 is a three-dimensional network topology diagram for the five-star network 
and higher scale node of Fig. 4 with arrows showing down-scale traffic; 

Fig. 6 is a three-dimensional network topology diagram for the five-star network 
and higher scale node of Fig. 4 with arrows showing up-scale traffic; 

Fig. 7 is a three-dimensional network topology diagram for the five-star network 
and higher scale node of Fig. 4 with arrows showing local traffic; 

Fig. 8 is a three-dimensional network topology diagram for a 30-node network 
portion, 

Fig. 9 is a two-dimensional network topology diagram for a 30-node scaled-star 
network; 

Fig. 10 is a simplified two-dimensional diagram of the network of Fig. 9; 

Fig. 1 1 is a simplified two-dimensional diagram of the network of Fig. 9 showing 
an illustrative single-hop inter-area transfer; 

Fig. 1 1 is a simplified two-dimensional diagram of the network of Fig. 9 showing 
an illustrative double-hop inter-area transfer; 

Fig. 12 is a simplified two-dimensional diagram of the network of Fig. 9 showing 
another illustrative double-hop inter-area transfer; 
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Fig. 13 is a flowchart illustrating the operation of the network of Fig. 9; and 
Fig. 14 is a simplified two-dimensional diagram of a network according to the 
invention that uses two scale levels. 

Detailed Description of an Illustrative Embodiment 

Referring to Fig. 3, an illustrative network NT according to the invention includes 
a number of low-scale subnetworks or areas Al, A2, A3, A4, and a high-scale 
subnetwork or scale S. The low-scale subnetworks and the high-scale subnetwork both 
include a series of interconnected nodes. These nodes can represent different types of 
network elements, such as switches, routers, or processors, and the interconnections can 
represent wired, wireless, or virtual signal paths that are continuously or intermittently 
available. 

In one embodiment, the illustrative network is implemented as a packet-based 
Ethernet LAN switch made up of a series of digital switches and external connectors 
interconnected by internal circuit lines. This switch can employ a modular construction 
in which the subnetworks are implemented as separate entities, such as circuit boards or 
integrated circuits. These modular entities can then be assembled to achieve different 
network configurations. 

The nodes in the low-scale network have a predetermined capacity and nodes in 
the high-scale subnetworks have a predetermined capacity that is higher than that of the 
nodes in the low-capacity subnetworks. In communication networks, capacity will 
generally be understood to the node's worst-case bandwidth, although other capacity 
measures may also be useful. In this embodiment, the low-scale subnetworks and the 
high scale subnetworks are all five-node mesh networks (i.e., n=5), and the higher scale 
nodes have four times the capacity of the lower scale nodes. 

There are a number of interconnections between the low-scale subnetworks and 
the high-scale subnetwork. In this embodiment, there is an interconnection between each 
node in the high-scale subnetwork (SI, S2, S3, S4, and S5) and one different, 
corresponding node in each of the low-scale subnetworks (respectively A1N1, A2N1, 
A3N1, A4N1; A1N2, A2N2, A3N2, A4N2; A1N3, A2N3, A3N3, A4N3; A1N4, A2N4, 
A3N4, A4N4; and A1N5, A2N5, A3N5, A4N5). This inter-scale connection topology 
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can be analogized to a series of intersecting barrels. Each barrel has a the same top, but a 
different base, and the top and bottom are interconnected by a series of vertical 
connections, like the slats of a barrel. 

The topology employed in the illustrative network effectively separates local 
neighbor traffic from traffic that is more distant. This separation of traffic classes by 
distance can be analogized to the inclusion of higher speed lanes on a highway. The 
higher speed lanes are separated from local exchange traffic preventing the two from 
interfering with each other. 

To understand some of the benefits of the topologies according to the invention, it 
is useful to examine smaller network portions. Fig. 4 presents a network portion PI that 
will be used to illustrate the effects of connecting a higher scale node to lower scale 
nodes Nl, N2, N3, N4, N5 in a five-node star area. The external link at the scale node 
has five times the capacity of the external links at each node within the star network. 

Referring to Fig. 5, inbound traffic I from the higher scale SI node need not result 
in additional neighbor node traffic within the lower scale nodes Nl , N2, N3, N4, N5 in 
the star network. Since the scale node is connected to all of the lower scale nodes, traffic 
introduced at the higher scale node S can follow a direct path to each node within the 
small star network. If the scale link were to carry traffic at capacity for each node within 
the area to destination on their external links, each scale link would be at capacity and the 
external link for S would be at capacity. The inter-node local links, however, would have 
no data traffic. The scale node can therefore saturate the area nodes without affecting the 
traffic between nodes. 

Referring to Fig. 6, traffic at scale also supports any combination of traffic from 
the area nodes. The capacity of the external link of the scale node S is n times the 
capacity of the links of the node within the area. As a result, even the maximum traffic 
level from all n nodes in the star will not saturate the scale node. 

And, as presented in Fig. 7, no level of inter-node traffic within an area will load 
the inter-scale traffic. As discussed above, the star network provides adequate capacity 
for any level of communication between the nodes in the network. Traffic within the 
network therefore need not be routed through the scale node outside of the star network 
to reach other nodes in the network. 
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Figs. 4-7 demonstrate that traffic breaks down into three directional classes: area 
local, upscale (away from the area), and downscale (toward the area). These figures also 
show that as long as the external link at the scale switch is n times greater than the 
external links within an area of n nodes, the area traffic will not congest the next scale 
traffic under any conditions. 

Referring to Fig. 8, it is also useful to examine a larger network portion P2 to 
understand the various properties of networks according to the invention. This network 
portion includes a star-connected, high-scale subnetwork. Each node in this subnetwork 
is connected to each of five nodes in a different one of five low-scale, star-connected 
subnetworks. 

Although this network portion is of a more useful density level than the network 
portion PI discussed above in connection with Figs. 4-7, two problems remain relative to 
the scaled star network shown in Fig. 3. First, since the scale interconnects for an area 
connect to the same scale node, a failure in that scale node will isolate the area from the 
rest of the network. In addition, communication between areas must always make one 
hop in the high-scale subnetwork to reach a node within another area. 

Referring to Fig. 9, placing inter-scale links from one area to different nodes at a 
higher scale mitigates both problems, while maintaining traffic class separation. In the 
two-dimensional view presented in Fig. 9, a circle replaces the local area-node 
complexity. As was shown in Fig. 3, each node within an area can connect to the same 
numbered node at the higher scale. This scaled-star interconnection scheme eliminates 
the single-node failure isolation and reduces the number of hops for inter-scale 
connections. 

Referring to Fig. 10, the full three-dimensional and partially simplified two- 
dimensional representations of the interconnections for scaled star topologies presented in 
Figs. 3 and 9 of this application are unfortunately quite complex for all but the simplest 
networks. It is therefore useful to represent such networks using more highly simplified, 
shaded two-dimensional diagrams. In these diagrams, a scaled star topology appears as a 
series of balls clustered together within other balls. Each star-interconnected area 
subnetwork of nodes Al, A2, A3, A4, A5 grouped together by local neighbor links is 
represented as a small ball. A larger ball represents the nodes and interconnections of the 
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scale subnetwork S. Showing the smaller balls surrounded by the larger balls implies that 
area subnetworks are connected to a scale subnetwork by inter-scale links. The surface 
of each small ball includes nodes within an area. The small balls representing areas are 
represented as evenly spaced within the larger ball because each switch on the surface of 
the small balls connects with a corresponding scale switch on surface of the large ball. 
Data flow at a given scale level (intra-area) in this model is viewed as flowing along the 
surface of a ball. Only when data flows between scales does the data penetrate a ball or 
emit from a ball. 

Referring to Fig. 1 1, the performance of the single-scale, n = five, star topology 
network of Figs. 9 and 10 will now be discussed. First, for traffic within an area, the 
performance mirrors star topology performance with one hop for both minimum and 
maximum performance. For inter-area traffic, traffic must exit an area for an upscale hop 
HU. If a scale node S directly connects a departure area node (e.g., A2N1) to a 
destination area node (e.g., A3N1), data would then travel directly back down to the 
destination area and node in a second hop HD (see also the path from A2N1 to A3N1 via 
SI in Fig. 3). This path will occur on average 20% of the time for n = five scaled star 
topologies, and is available because each switch is cross-connected between the areas and 
the scale switches. 

As shown in Fig. 12, when a scale node S does not directly connect a departure 
area node (e.g., A2N1) to a destination area node (e.g., A4N2), data can not travel 
directly back down to the destination node after the initial upscale hop HU. Instead, it 
must make another hop, for a total of three hops. As shown in Fig. 12, this hop can be a 
first scale-level hop HS that takes place before a final downscale hop HD (see also the 
path from A2N1 to A3N2 via SI in Fig. 3). This path will occur on average 80% of the 
time for n = five scaled star topologies. Note that other types of three-hop 
communications could also exist, in which additional hops occur in either the departure 
or destination areas, but these can interfere with other traffic in these areas. 

The performance of a scaled star topology with five-node areas (n = 5) and one 
scale level (s — 1) is summarized in Table 3. 
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Minimum Hops 



Maximum Hops 



Intra-Area 



Inter-Area 



Table 3 

A marginal increase in hop distance or connective performance from star topologic 
performance is apparent from Table 3. But this topology has inter-connected thirty nodes 
at two scale factors essentially without inter-dependencies that would affect performance 
between any two node pairs. All communication characteristics are instead deterministic 
between any source and destination pair. 

Referring to Fig. 13, because scaled star networks can be designed to allow for 
deterministic communication characteristics between any source and destination pair, 
they can exhibit excellent performance even under heavy loads. Communication can be 
allowed (step 12) between any two nodes in the network independent of other traffic on 
the network, as long as it is determined that both nodes themselves have enough free 
capacity to support the communication (step 14). This aspect of the protocol can be 
implemented in the network with simple communication-enabling logic, which allows or 
disallows communication between nodes based on their available capacities. 

In addition, because routing is independent of traffic conditions, it can be greatly 
simplified. Since all paths are deterministic, routing functions need only depend only on 
the identity of the destination node. When faults occur, a simple round-robin protocol 
can be followed to distribute fault traffic through different fault paths. For example, 
when a failed scale node makes an area node unreachable directly, traffic to it is 
successively routed to it via each of the other nodes in the area. When an end node fails, 
virtual channels between it and other nodes will time out, freeing up bandwidth for other 
connections. 

Each node maintains a data structure expressing its aggregate capacity. When a 
virtual channel is established between two nodes, these nodes use the data structure to 
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allocate a portion of their capacity to the channel. When a channel is no longer needed, 
the capacity can be allocated to other channels. When all of a node's capacity has been 
used up, further channels can be refused. This simple data structure, coupled with the 
simple routing protocol described above, and the ability to negotiate channel set-up allow 
a simple, inexpensive node to perform as part of a high-performance network. 

Networks according to the invention can exhibit monotonic or even linear 
performance. As the number of communications carried by the network increases, the 
throughput of the network generally increases at a proportional rate, resulting in a linear 
performance characteristic. When no more communications can be made, the 
performance characteristic can no longer increase, and the performance characteristic 
stays at a particular maximum level. This performance characteristic is a substantial 
improvement over some prior art network architectures whose performance improves 
with demand up until a certain level, but then degrades substantially as the network 
becomes congested. This type of nonlinear, non-monotonic performance characteristic 
can be particularly vexing because network performance decreases during periods of 
highest demand, when such performance decreases are most disruptive. 

The cost of these improvements to the inter-node connectivity level of the 
network will now be analyzed, beginning with an examination of bandwidth between 
scales for conditions of no congestion. If the base or intra-area bandwidth is represented 
by bw, then for the second scale to handle full carrying capacity of any area its bandwidth 
would have to be n (bw). Including the effects of the scale levels, the formula becomes 
(n A s)(bw), for the bandwidth at each scale required for full capacity. 

The number of nodes associated with a scaled star can be derived from the 
following formula: 

Zn A (s+l), for s starting at zero, s = 0. 

For s = 1 and n = 5, the total number of nodes is therefore equal to n A 2 + n A l = n A 2 + n, 
with n = 5, which results in a total number of nodes that is equal to 30. 

The total number of links required will now be determined. The formula 
presented above for star topologies can be used to determine the number of links per area 
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and the number of links within a scale. Since the total number of links per area including 
scale links is: n(n+l)/2, and the number of links at scale is n(n-l)/2 these terms can be 
determined by: 

I n A (s-l) [n (n (n+l))/2] + n A (s-l)[n(n-l)/2] 

For s = 1, this becomes (n A 2)(n+l)/2 + n(n-l)/2, and with n = 5, it becomes 150/2 + 20/2 
= 85. This reduces to: 

l A X n A (s-l)[ (n A 3) + 2 (n A 2) - n ], from s=l . 

The inter-scale links can be shared links of the higher scale or individual links of the 
lower scale. These formulas are based on the links being of lower scale. If the links are 
of higher scale and shared, the formula for the total number of links changes to: 

I n A (s-l)[n (n (n-l))/2 + 1] + n(n-l)/2] 

For s = 1, this becomes (n A 2)(n-l)/2 + n + n(n-l)/2, and for n = 5, it becomes 100/2 + 5 + 
20/2 = 65. This reduces to: 

V* 1 n A (s-l)[ (n A 3) + n ], from s=l. 

In this illustration, node density has grown into the high-density category, and based on 
tabulated values, hop performance has increased by two hops per scale. 

Methods of increasing node density will now be discussed. These can include 
increasing the number of nodes per area, which increases the number of nodes directly in 
step with the star topology. Node density can also be increased by increasing the number 
of scales. For example, as shown in Fig. 14, an n=5, m=2 scaled star network can include 
five scales Sl-1, Sl-2, Sl-3, Sl-4, Sl-5 on a first level. These can each be connected by 
downlinks to the nodes in five areas. They are also connected by uplinks to a second- 
level scale area S2. Such a tree will have a series of scale factors, which may be different 
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from each other. The chosen distribution of scale factors will depend on design 
constraints, such as the relative cost of nodes and interconnections in the implementing 
technology, whether there are to be external links at intermediate levels, and the media 
capacity to be accommodated by the external links. Note that any scale level may or may 
not have external links, but the capacity of the nodes bearing those nodes will have to be 
doubled, to keep the structure balanced. 

As shown in Table 4, each added scale increases the node density in a uniform 
manner and marginally decreases the connective performance. For example, Fig. 14 
shows a two-scale, five-node star topology that increases node density to 155. 

Topology, Scaled Star, n = 5 Minimum Hops Maximum Hops 

S = l 1 3 

S = 2 1 5 

S = 3 1 7 

S = etc. 1 1 +2S 



Table 4 

Table 5 summarizes characteristics of the scaled star topology in the same format 
used for star topology and lattice topology. 

Node(s) Total Links per Node Min, Max. 

Links Hops Hops 

Xn A (s+l), See Below. 

From s = 0 See 
below. 

30(1) 85 75@S0, 10@S1 1 3 
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155 (2) 510 425@S0, 75@S1, 10@S2 1 5 

780(3) 2635 2125@S0, 425@S1, 75@S2, 10@S3 1 7 

3125 (4) 13260 10625@S0,2125@S1,425@S2, 1 9 

75@S3, 10@S4 



Table 5 



The total number of nodes is derived from Xn A (s+l), with s = 0. The total number of 
links is derived from Z n A (s-l)[ (n A 3) + 2 (n A 2) - n ]/2, with s=l . Links per node are 
terms within the expanded series for total links. Note that congestion cannot occur 
provided the total data flow into a high-density switch (or backbone network) never 
exceeds the total data flow out and if the bandwidth between nodes at each scale is equal 
to or greater than (n A s)bw, where bw represents area bandwidth. 

Star, lattice, and scale star topologies will now be compared. Throughout this 
discussion, n = 5, was used as the area connectivity depth. When inter-scale connections 
are included, however, this depth becomes six. The connective density of this type of 
network can therefore be fairly compared with the scale of a cubic lattice topology. In 
practice, the number of scales, nodes/area, and connections/node are design parameters 
that allow for adjustment of networking parameters. Table 6 presents parameters for the 
scaled star topology. 

Node(s) Total Links per Node Min. Max. 

Links Hops Hops 

In A (s+l), See Above 

From s = 0 See 

Above 

30(1) 85 75@S0, 10@S1 1 3 

155 (2) 510 425@S0,75@S1, 10@S2 1 5 



14 



780(3) 2635 2125@S0, 425@S1, 75@S2, 10@S3 1 7 

Table 6 



Table 7 presents parameters for the mesh topology. 

Node n Total Links Node Links (n-1) Min & Max Hops Fault Hops 
Z(n-1) or 
n(n-l)/2 

25 300 24 1 2 

125 7750 124 1 2 

500 124750 499 1 2 

Table 7 

Table 8 presents parameters for the lattice topology. 

Node Total Links Node Links Con. Min. Max. 

(n) Ratio Hops Hops 

(n A 3)(n- 1 ) Corner: 8 @ 3, Edges: 12(n-2) @ 4, 

n A 3 Face: 6 (n-2) A 2 @ 5, Inner: (n-2) A 3 @ 6 

27 (3) 54 8@3, 12@4, 6@5, 1@6 4/1 1 9 

125(5) 500 8@3, 36@4, 54@5, 27@6 4/1 1 15 

729(9) 5832 8@3, 84@4, 294@5, 343@6 4/1 1 27 

Table 8 
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The different topologies can be compared at the same approximate scale, by comparing 
corresponding lines of Tables 6-8, At the lowest node density, the scaled star topology 
has a greater connective density than the lattice topology but also has a three-fold 
improvement in hop performance. At a medium node density, the scaled star topology 
exhibits three times better hop performance than the lattice topology, but their connection 
densities are about the same. This occurs because the star topology scales by n times 
while the lattice connectivity has an n A 3 scale factor. 

At the highest node densities, scaled star topologies out-perform lattice topologies 
by better than three to one. And high-density scaled star topologies require less than half 
of the connections required by comparable lattice topology fabric. Clearly, for medium 
and high-density fabrics, scaled star topologies allow for significant reductions in 
connection density with better performance over lattice fabrics in all cases. Note that 
intermediate connection levels are achievable by partially populating a level or by 
adjusting node/area ratio. The nodes at intermediate scales are not required to have 
external links if the scale ratio between the level would be less than a media aggregate. 
These changes have no effect on hop distance performance, however, as only the addition 
of a scale increases hop distance. 

The separation between local, remote, and high bandwidth traffic also assures that 
local neighbor performance never diminishes as traffic load increases. And if bandwidth 
scales are maintained, no congestion control is required between switches within the 
fabric. 

Properties of star-connected topologies will now be presented in more detail. In this 
section, a scaled star topology is considered to be balanced when, i = j = k, for any m > 0. 
Pure scaled star topologies are characterized by the following: 

1. They include a set of subnetworks, called areas, of nodes, in which each area node is 
connected to each other area node to form a mesh or star of interconnections. These 
connections are known as intra-area connections. 

2. They also include another set of subnetworks, called scales, of nodes, in which each 
scale node is connected to other scale nodes to form a mesh or star of 
interconnections. These connections are known as intra-scale connections. 
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3. Each node within an area connects to a specific node within the next higher scale. 
These interconnections are known as inter-scale connections. 

4. When multiple scales exist, multiple areas of scale switches are called area scales. 

5. Each scale area node connects to a specific node within the next higher scale. These 
connections are known as inter-scale connections. 

The following formulas designate the connective relationships for areas, scales, 
and inter-scale connections: 

Let N designate nodes, Nl . . .Ni, where i designates the total number of nodes in an 
area. 

Let A designate areas, Al . . . Aj, where j designates the total number of areas in a 
scale. 

Let S designate scales, SI . . .Sm, where m designates the total number of scales in a 
scaled star network topology. 

Let SmNk designate scale nodes, where k designates the nodes at a scale. 

For intra-area connections, each of an area's nodes, AjNi, are interconnected such that: 

A1N1 connects to A1N2, A1N3, A1N4,..., AINi 
A1N2 connects to AIM, A1N3, A1N4,..., AINi 

AINi connects to AINI, A1N2, A1N3,..., AlN(i-l) 

These interconnections repeat for each Aj: 

AjNl connects to AjN2, AjN3, AjN4,, . ., AjNi 
AjN2 connects to AjNl, AjN3, AjN4,..., AjNi 

AjNi connects to AjNl, AjN2, AjN3,..., AjN(i-l) 
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For inter-area scale connections in networks where m > 0, each of an area's nodes, AjNi, 
has inter-area connections to each scale node, SINk, described by the following: 

A1N1 connects to S1N1. 
A1N2 connects to S1N2. 
A1N3 connects to S1N3. 

AIM connects to SINk. 

These interconnections repeat for each Aj: 

AjNl connects to S1N1. 
AjN2 connects to S1N2. 
AjN3 connects to S1N3. 

AjNi connects to SINk. 

For intra-scale connections for any scale and for m > 0, each scale node, SmNk, has 
connections to each node at the same scale described by the following: 

S1N1 connects to S1N2, S1N3, S1N4,..., SINk 
S1N2 connects to S1N1, S1N3, S1N4,..., SINk 

SINk connects to S1N1, S1N2, SlN3,...,SlN(k-l) 

These interconnections repeat for each Sm: 

SmNl connects to SmN2, SmN3, SmN4,.. SmNk 
SmN2 connects to SmNl, SmN3, SmN4,..., SmNk 

SmNk connects to SmNl, SmN2, SmN3,..., SmN(k-l) 
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For inter-scale connections in networks where m >1, each area node, AjNi, has inter-area 
connections to each scale node, SINk, described by the following: 

S1N1 connects to S2N1. 
S1N2 connects to S2N2. 
S1N3 connects to S2N3. 

SINk connects to S2Nk. 

These interconnections repeat for each Sm-1: 

S(m-1)N1 connects to SmNl. 
S(m-1)N2 connects to SmN2. 
S(m-1)N3 connects to SmN3. 

S(m-l)Nk connects to SmNk. 

The pure scaled star topology of the full networks presented above exhibit a 
number of advantages and are particularly well-suited to a variety of networking tasks. 
They can be modified in a number of ways, however, while still retaining at least some of 
their beneficial properties. For example, while each of the above networks exhibits a 
homogeneous area count n with nodes of equal capacities within an area, these numbers 
can be different within or between levels. Such heterogeneous area count and capacity 
could be the result of the deliberate partial population of areas, such as for cost reasons, 
or it may also be the result of other design objectives. A larger area with lower capacity 
nodes might serve more, smaller machines, for example, while a smaller area with higher 
capacity nodes might serve fewer, larger machines. Or different areas might be used for 
different types of communication media. Note that an abnormally small node in the 
lowest area level will not affect traffic congestion, except that it will reduce the amount 
of traffic that it is capable of handling. 



19 



In addition, while uniform scaling would best suited for many applications, the 
tree formed by the topology can be asymmetrical For example, some branches may be 
deeper and/or may account for more traffic capacity at higher scale levels. This may be 
the result of deliberate partial population of areas, or other design objectives. 
Furthermore, while the intersecting-barrel connection scheme provides appropriate 
performance for many objectives, other inter-scale connections may be appropriate. For 
example, it may be possible to provide additional connections between layers, such as to 
improve fault performance. Certain applications may even tolerate area nodes without 
connections to the scale level. 

The bandwidth at each scale and performance of scaled star networks will now be 
discussed in more detail. If the bandwidth of intra-area and inter-area connections is bw 
and the bandwidth of intra-scale and inter-scale connections follows the following 
formula, the topology will not congest under non-fault conditions. 

Scale bandwidth >= (n A s)bw, for no congestion, without path routing (optimum 
path only). 

If the bandwidth each intra-scale connection maintains is greater than or equal to total 
inter-scale capacity of the lower scale connection divided by the total number of intra- 
connections at scale, then no congestion performance may be obtained, but a flow-based 
path routing protocol will be required. 

Imbalanced scaled star topologies can also be constructed by connecting one or 
more non-star areas or sub areas of any scale within a scaled star topology. To integrate 
the non-star topologies into an unbalanced but scaled star topology, the connections to the 
next higher scale must follow the inter-scale formula presented above. No negative 
impact on performance at scale or inter-scale occurs within the fabric for other scaled star 
sub areas or sub scales. However, the performance of the imbedded non-star topologies 
will not follow a predictable pattern. 

Another type of imbalance can exist within areas of sub-scales with a scaled star 
topology. This type of imbalance exists when areas at the same scale have different node 
densities. If the areas fall into a multiple of the next scale, it's possible to increase the 
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number of inter-scale connections for these areas or sub scales. The capacity of intra- 
scale connections for the next higher scale would become the total inter-scale capacity of 
all sub-scale areas divided by the total connections at scale for conditions of no 
congestion. If the node densities are not a multiple of the number of nodes at the next 
scale, but the inter-scale connections formula is maintained, the fabric performs as 
defined for non-star area or sub scale areas. 

Because each scale may be composed of more switch elements than the sub 
scales, many combinations of scaled star topologies exist. When designing imbalanced 
scale star topologies, it is important to integrate the non-star topologies into the star fabric 
without adversely affecting the efficiency of the fabric overall As long as the inter- 
connection between the sub-area and the up scale links maintain a capacity profile of the 
upscale intra-scale links, no congestion will be introduced to the fabric overall by the 
imbalance topology. 

As presented above, scaled star interconnected networks present a number of 
advantages for the implementation of a variety of types of networks. More complex and 
impure network forms may also implemented, and these may still exhibit a number of 
advantages over the prior art. For example, it may by possible to make changes to the 
node structure that impair the theoretical performance of a network, such as its balance, 
but do not significantly impede practical performance, because they are statistically 
insignificant in actual operating conditions. 

The present invention has now been described in connection with a number of 
specific embodiments thereof. However, numerous modifications which are 
contemplated as falling within the scope of the present invention should now be apparent 
to those skilled in the art. Therefore, it is intended that the scope of the present invention 
be limited only by the scope of the claims appended hereto. In addition, the order of 
presentation of the claims should not be construed to limit the scope of any particular 
term in the claims. 

What is claimed is: 
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